
INFORMATION PROCESSING METHOD AND 
RECORDING MEDIUM 

BACKGROUND OF THE INVENTION 
5 (1) Field of the Invention 

This invention relates to an information processing 
method and a recording medium, and more particularly to an 
information processing method and a recording medium which 
are capable of causing a computing device having a 
10 plurality of processors to carry out predetermined 
information processing. 

(2) Description of the Related Art 

When a computing device having a plurality of 

15 processors is caused to execute a progreim, there has been 
generally employed a method of dividing the program into a 
plurality of parallel processing blocks, and dividing each 
of the obtained parallel processing blocks into threads 
which are basic units for processing, and assigning the 

20 threads to the processors, 

FIG. 10 is a diagram showing a case in which a 
progreim on a left-hand side as viewed in the figure is 
executed by the above method by using a computing device 
having five processors. In this example, the program to be 

25 executed includes two loops to be executed (line numbers 
"1" to "3" and line numbers "5" to "7") which are set to a 
first parallel processing block and a second parallel 
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processing block, respectively. 

When the above program is executed, threads #1 to #5 
are generated as basic units to be processed by the 
respective processors. The thread #1 takes its share of a 
5 first loop (loop with line numbers "1" to "3") with a 
variable i within a range of "1" to "200". The thread #2 
takes its share of the same first loop with the variable i 
within a range of "201" to "400". Similarly, the threads #3, 
#4, and #5 take their shares of the first loop with the 

10 variable i within ranges of "401" to "600", "601" to "800", 
and "801" to "1000", respectively. 

In the conventional method, however, a monitoring 
mechanism called "barrier" is arranged between the parallel 
processing blocks to thereby hold a next parallel 

15 processing block from being executed until processing of 
all the threads is completed. 

As a result, when a plurality of parallel processing 
blocks are to be processed, a time period required for 
processing all the blocks becomes equal to a sxom of the 

20 longest time periods each of which is taken to process the 
most time-consuming one of the threads of each parallel 
processing block. As a result, it is sometimes impossible 
to make effective use of the processor resources. 

25 SUMMARY OF THE INVENTION 

The present invention has been made in view of the 
above circumstances, and an object thereof is to provide an 
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information processing method which is capable of making 
effective use of processor resources, thereby reducing a 
processing time. 

To attain the above object, the present invention 
5 provides an information processing method for causing a 
computing device having a plurality of processors to carry 
out predetermined information processing. The information 
processing method comprises a parallel processing block- 
forming step for dividing a program to be executed into a 

10 plurality of parallel processing blocks, a thread- forming 
step for dividing said parallel processing blocks formed by 
said parallel processing block-forming step, into threads 
which are basic units to be assigned respectively to said 
plurality of processors for being processed thereby, and an 

15 instructing step for instructing a predetermined processor 
to execute a next parallel processing block when said 
predetermined processor has terminated execution of said 
thread assigned thereto. 

The above and other objects, features and advantages 

20 of the present invention will become apparent from the 
following description when taken in conjunction with the 
accompanying drawings which illustrate preferred 
embodiments of the present invention by way of example. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG . 1 is a diagram useful in explaining the 
operating principles of the present invention ,- 
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FIG. 2 Is a block diagram showing an example of the 
arrangement of an embodiment according to the invention; 

FIG. 3 is a diagram showing the relationship existing 
between a compiler, a linker, and a library according to 
5 the invention when an OS (Operating System) stored in the 
HDD is started up in the FIG. 2 embodiment, and the 
compiler, the linker and the library are executed on the 
OS; 

FIG. 4 is a diagram showing an example of a source 
^ 10 program appearing in FIG. 3; 

FIG. 5 is a block diagram which is useful in 
^ explaining an operation carried out when an execution form 

1: program is executed; 

^ FIG. 6 is a block diagram showing memory regions of a 

H 15 RAM allocated to a thread control section and first to 
^ fifth threads shown in FIG. 5; 

^ FIG. 7 is a diagram which is useful in explaining 

operations shown in the block diagrams in FIGS. 5 and 6 
which are carried out during execution of an execution form 
20 program generated from the FIG. 4 source program. 

FIG. 8 is a diagram which is useful in explaining how 
threads are executed by the embodiment ; 

FIG. 9 is a flowchart which is useful in explaining 
an example of processing executed by a thread control 
25 section shown in FIG. 5; and 

FIG. 10 is a diagram which is useful in explaining 
how threads are executed by the prior art. 
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DESCRIPTION OF THE PREFERRED EMBODIMENT 
A preferred embodiment of the present invention will 
be described below with reference to accompanying drawings . 
5 FIG. 1 is a diagram showing the principles of an 

information processing method according to the invention. 
As shown in FIG. 1, the information processing method 
according to the invention is directed to causing an 
information processing system including a processor group 4 
y 10 to carry out predetermined information processing. The 
information processing method according to the invention 
comprises s a parallel processing block-forming step 1, a 
i;L: thread- forming step 2, and an instructing step 3. 

The parallel processing block- forming step 1 divides 
;:P 15 a program to be executed into a plurality of parallel 
^3 processing blocks. 

N The thread- forming step 2 divides the parallel 

processing blocks into threads which are basic units to be 
assigned respectively to the processors of the processor 

20 group 4, for being processed thereby. 

The instructing step 3 instructs a predetermined 
processor to execute a next parallel processing block when 
the processor has terminated execution of the thread 
assigned thereto, whereas when a predetermined instruction 

25 is given in the program, the instructing step 3 does not 
instruct execution of a next parallel processing block 
until processing of all the threads has been completed. 
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Next, the above operations illustrated in FIG. 1 
showing the principles of the information processing method 
will be described in detail hereinafter. 

Now, when a program to be executed is input, the 
5 parallel processing block-forming step 1 divides the 
program into a plurality of parallel processing blocks. It 
should be noted that the term "parallel processing block" 
is used to mean a processing unit, such as a loop process, 
which has certain properties of a functional unit. 

10 Therefore, when a plurality of loop processes are included 
in a program, they are divided as respective parallel 
processing blocks. 

The thread -forming step 2 sequentially obtains the 
parallel processing blocks generated by the parallel 

15 processing block-forming step 1 in the order of execution, 
and divides each of them into threads which should be 
processed by the respective processors. In the example 
illustrated in FIG. 1, five processors exist, and therefore 
each parallel processing block is divided into five threads. 

20 The processor group 4 processes the threads generated 

by the thread- forming step 2 in a manner such that each 
processor of the group processes a thread assigned thereto. 
At this time, since details of processing executed by the 
respective processors are not identical, timing of 

25 termination of the processing is different between the 
processors . 

Conventionally, termination of processing by each 
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processor has been monitored by using a barrier until the 
processing of the whole processing block is completed* 
Therefore, even if a processor has completed its processing 
earlier than the others, the processor has to wait for all 
5 the others to complete their processing. 

In the present invention, however, when a 
predetermined processor has completed its processing, the 
instructing step 3 instructs execution of a next parallel 
processing block unless a predetermined instruction is 

10 given in the program. Hence, the processor that has 
completed execution of a thread assigned thereto earlier 
than the others can execute a thread of the next parallel 
processing block. 

After threads continue to be executed, if the 

15 predetermined instruction in the program is reached, the 
instructing step 3 holds the program from proceeding to a 
next parallel processing block. This enables all the 
threads to be synchronized with each other. 

As described above, although in the conventional 

20 method, a sum of the longest time periods each of which is 
taken to process the most time-consuming one of the threads 
of each parallel processing block has been an execution 
time of the program, according to the information 
processing method of the invention, it is possible to 

25 shorten the program execution time unless all threads 
requiring the longest execution time periods are assigned 
to a particular processor. 
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Next, the embodiment according to the invention will 
be described hereinafter. 

FIG, 2 shows an example of the arrangement of an 
information processing system for carrying out the 
5 information processing method according to the embodiment 
of the invention. 

In this embodiment, the information processing system 
10 is comprised of PUs (Processor Units) 10a- 1 to 10a- 5, a 
ROM (Read Only Memory) 10b, a RAM (Random Access Memory) 
10 10c, an HDD (Hard Disk Drive) lOd, a GB (Graphics Board) 
lOe, an I/F (interface) lOf , and a bus lOg. The information 
processing system 10 has peripheral devices, such as a 
display device 11 and an input device 12, connected thereto. 

The PUs lOa-1 to 10a- 5 perform various computational 
15 operations according to a program stored in the HDD lOd and 
controls operations of components of the system. 

The ROM 10b stores basic programs and data to be 
executed and processed by the PUs 10a- 1 to 10a- 5. 

The RAM 10c temporarily stores programs and data 
20 being executed and processed by the PUs 10a- 1 to 10a- 5. 

The HDD lOd stores progreuns and data for execution 
and processing by the PUs lOa-1 to lOa-5. More specifically, 
the HDD lOd stores an OS (Operating System) which is a 
basic program for managing the system and providing a basic 
25 user operating environment, as well as a compiler, a linker, 
an application program and the like, which are to be 
executed by the PUs 10a- 1 to 10a- 5, according to the 
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invention . 

The GB lOe carries out an imaging process according 
to an imaging command supplied from the PUs lOa-1 to 10a- 5, 
and converts an obtained image to a video signal to output 
5 the same . 

The I/F lOf performs inputting of data received from 
the input device 12 by converting the data to an expression 
form used by the system. 

The bus lOg connects the PUs 10a- 1 to 10a- 5, the ROM 
10 10b, the RAM 10c, the HDD lOd, the GB lOe, and the I/F lOf 
to each other, thereby making it possible to send and 
receive data therebetween . 

It should be noted that the PUs 10a- 1 to 10a- 5 are 
capable of carrying out parallel processing in which a 
15 program to be executed is divided into a plurality of 
parallel processing blocks and then processed. When the ROM 
10b and the like, which are shared resources, are accessed 
by the PUs during execution of the parallel processing, 
exclusive access control is carried out such that the 
20 access by one PU is not adversely affected by access by the 
other processor units. 

Although in the above example, description of the 
arrangement of the embodiment is partially omitted for 
simplicity, it is only essentially required that the 
25 information processing system has a plurality of PUs which 
are capable of operating independently of each other. 

FIG. 3 is a diagram showing the relationship between 
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the compiler, the linker, and a library according to the 
invention which are executed on the OS which is started up 
by reading from the HDD lOd in the FIG. 2 embodiment. As 
shown in FIG. 3, a source program 20 to be executed is 
5 compiled (translated) by the compiler 21, and necessary 
ones of programs stored in the library 23 which are basic 
programs are added to the source program 20 by the linker 
22, thereby generating an execution form program 24. It 
should be noted that the invention is concerned with 

10 details of the library 23, and the use of a novel control 
method described hereinafter makes it possible to increase 
processing speed of the parallel processing. 

FIG. 4 shows an example of the source program 20 
appearing in FIG. 3. 

15 In this source program 20, line number "1" declares 

arrays m, n, and p of an integer type, with the respective 
numbers of elements of 1000, 2000 and 3000. Line number "3" 
declares execution of parallel processing. This declaration 
forms a pair together with a declaration of "END" shown by 

20 line number "19". A process indicated by line numbers "4" 
to "8" forms a loop process which is carried out for 
storing the value of a variable i as each element of the 
array m. Also, a process indicated by line numbers "9" to 
"13" forms another loop process which is executed for 

25 storing a value obtained by multiplying the variable i by 
two as each element of the array n. Further, a process 
indicated by line numbers "14" to "18" forms still another 
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loop process which is carried out for storing a value 
obtained by multiplying the variable i by three as each 
element of the array p. 

Hereinafter, the process indicated by line numbers 
5 "4" to "8" is referred to as "the first loop process", the 
process indicated by line numbers "9" to "13" is referred 
to as "the second loop process", and the process indicated 
by line numbers "14" to "18" is referred to as "the third 
loop process". "NOWAIT" appearing in line numbers "8", "13" 

10 and "18" means that wait processing should not be carried 
out. A barrier function is held from execution by adding 
this declaration. 

It should be noted that the number of parallel 
processes can be designated by a program, not shown, for 

15 initialization of the system. Further, in the source 
program 20 as well, it is possible to specify the number of 
parallel processes as desired by a predetermined command 
written therein. 

As described hereinabove, the source program 20 is 

20 translated by the compiler 21, and after necessary ones of 
the programs included in the library 23 are added by the 
linker 22, the source progremi 20 is converted to the 
execution form progrcim 24. Further, when compiling, the 
source program 20 is divided into parallel processing 

25 blocks as units of parallel processing, and parallel 
processing block numbers which are unique numbers are added 
to the respective parallel processing blocks. In the 



- 11 - 




example of the source program illustrated in FIG. 4, each 
of the first to third loop processes is a parallel 
processing block, so that parallel processing block numbers 
of one to three, for instance, are added to the respective 
5 parallel processing blocks. 

FIG. 5 is a diagram which is useful in explaining an 
operation carried out when the execution form progreun 24 is 
executed. In FIG. 5, the execution form program 24 is 
generated by compiling the FIG. 4 source program 20 into 
% 10 machine language, and includes the first to third loop 
.1 processes described above. A thread control section 60 and 

''^ first to fifth threads 61 to 65 are programs added by the 

linker 22 for carrying out parallel processes, and they are 
l^^ subroutine programs called from the execution form program 

]f: 15 24 for execution. 

;^ Now, when the thread control section 60 is called 

'-^ from the first to third loop processes which are parallel 

processing blocks, the thread control section 60 starts the 
first to fifth threads 61 to 65 for causing the parallel 
20 processes to be carried out and controlling the states of 
execution of the threads. The first to fifth threads are 
basic units of processes executed by the PUs 10a- 1 to 10a- 5. 

FIG. 6 shows memory regions of the RAM 10c allocated 
to the FIG. 5 thread control section 60 and first to fifth 
25 threads 61 to 65 when they are executed. In FIG. 6, thread 
information regions 71 to 75 are assigned to the respective 
first to fifth threads 61 to 65, and store respective 
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parallel processing block numbers 71a to 7 5a indicative of 
the numbers of parallel processing blocks which the 
respective threads are executing at the present time. A 
parallel processing control information region 76 is 
5 assigned to the thread control section 60, and stores a 
parallel processing block number 76a indicative of the 
number of a parallel processing block executed by a 
foremost thread . 

Parallel processing block control information regions 

10 77 and 78 are generated in a manner corresponding to 
parallel processing blocks being executed at the present 
time. The parallel processing block control information 
regions 77 and 78 store executed thread numbers 77a and 78a 
indicative of the number of threads of the respective 

15 parallel processing blocks which have already been 
terminated. In the illustrated example, the two parallel 
processing block control information regions 7 7 and 78 are 
generated and correspond to respective states of execution 
of the two parallel processing blocks. Further, in this 

20 example, the first thread 61 to the fourth thread 64 are 
executing a parallel processing block corresponding to the 
parallel processing block control information region 77, 
while the fifth thread 65 is executing a parallel 
processing block corresponding to the parallel processing 

25 block control information region 78. 

It should be noted that when three or more parallel 
processing blocks are being executed, parallel processing 
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block control information regions corresponding in number 
to the parallel processing blocks are generated, whereas 
when one parallel processing block is being executed, one 
parallel processing block control information region is 
5 generated* 

Next, operations shown in the block diagrams in FIGS. 
5 and 6 which are carried out during execution of the 
execution form program 24 generated from the FIG. 4 source 
program 20 will be described with reference to FIG. 7. 

O 

10 vnien the execution form program 24 is started up, the 

= ,1 first loop process having a parallel processing block 

JI number "1" is set to a process to be executed. In the first 

loop process, the thread control section 60 is called by 
subroutine call with arguments specified therefor, and is 

15 requested to start the loop process . The thread control 
^ section 60 sets the parallel processing block number of the 

parallel processing control information region 76 to "1", 
generates the parallel processing block control information 
region 77, and initializes the executed thread number 77a 

20 to "0". Then, the thread control section 60 generates the 
first to fifth threads to start execution of the first loop 
process. The first to fifth threads 61 to 65 each have the 
thread information regions 71 to 7 5 assigned thereto while 
storing the parallel processing block number "1" 

25 corresponding to the first loop process being carried out 
at the present time as the parallel processing block 
numbers 71a to 7 5a. 
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FIG. 7 is a diagram showing data stored in the thread 
information regions 71 to 75 and the parallel processing 
control information region 76. In FIG. 1, a first column at 
a left-side end to a fifth column correspond to the thread 
5 information regions 71 to 75, respectively, whereas a 
column at a right-side end corresponds to the parallel 
processing control information region 76. A first line in 
FIG. 7 indicates an initial state of the first loop process 
being started, on which only the first thread 61 has the 

10 parallel processing block number "1" stored therein while 
Ti the other threads have not yet stored the same. On a second 

line, all the columns other than the fifth column have 
stored the parallel processing block number "1", which 
indicates that all the threads other than the fifth thread 

15 65 are executing the first loop process. 
1 3 In the above state, when the second thread 62 has 

terminated execution of the first loop process, the thread 
control section 60 is notified of the fact. Then, the 
thread control section 60 detects that the first process 

20 loop has "NOWAIT" added at an end thereof to thereby 
recognize that the second thread should proceed to a next 
process without executing the barrier function, and first 
updates the executed thread number 77a from "0" to "1". 
Next, the thread control section 60 updates the parallel 

25 processing block number 76a in the parallel processing 
control information region 76 from "1" to "2", then 
generates the parallel processing block control information 
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region 78 corresponding to the second loop process and 
initializes the executed thread number 78a to "0". 

When such operations as described above are 
repeatedly carried out, and all the threads have terminated 
5 processing of the first loop process, the executed thread 
number 77a becomes equal to "5". At this time, the parallel 
processing block control information region 77 is deleted 
from the RAM 10c. 

When all the threads have terminated the third loop 

10 process, all the parallel processing block numbers 71a to 
75a become equal to "3" as shown by the last line in FIG. 7, 
and the execution of the program has been completed. 

Therefore, according to the embodiment described 
above, differently from an example of the prior art 

15 illustrated in FIG. 10, that is, the barrier function is 
not carried out as shown in FIG. 8, but each thread 
executes a next parallel processing block irrespective of 
the states of execution of the other threads. Therefore, in 
contrast to the FIG. 10 conventional case in which a total 

20 program execution time is a sum of the longest time periods 
each of which is taken to process the most time-consuming 
one of the threads of each parallel processing block, it is 
possible in the present embodiment to execute the program 
in a time period shorter than in the conventional case. 

25 Although in the above embodiment, the case in which 

the five PUs 10a- 1 to 10a- 5 process five threads is 
described by way of example, this is not limitative, but it 
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goes without saying that the present invention can be 
applied to other combinations of PUs and threads . 

Further, although in the above embodiment, threads 
are managed by the library 23, this is not limitative, but 
5 it is possible to obtain the same advantageous effects as 
provided by the embodiment if similar programs are added to 
the execution form program 24 by using the compiler 21* To 
this end, in-line expansion or macros, for instance, can be 
employed for the above addition. 

10 Still further, in the above embodiment, since 

"NOWAIT" is added to an end of every parallel processing 
block, each thread is permitted to continue to carry out 
processing operations up to the last parallel processing 
block independently of the other threads. Here, if "NOWAIT" 

15 is omitted, it is possible to once cause the threads to 
keep pace with each other. As described above, by adding 
"NOWAIT" as required, the barrier function can be made 
effective or ineffective. 

Next, referring to FIG. 9, processing carried out by 

20 the thread control section 60 will be described based on a 
flowchart shown therein. This flowchart corresponds to a 
process called for execution when the first to fifth 
threads 61 to 65 have terminated processing operations. 
When the flowchart is started, the following steps are 

25 carried out. 

Step SIC: 
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- The parallel processing block number of a 
corresponding thread information region is incremented by 
"1" . 

Step Sll: 

5 The parallel processing block number of the parallel 

processing control information region is assigned to a 
variable J . 

Step S12: 

The parallel processing block number of a 
10 corresponding thread information region is assigned to a 
variable k. 

Step S13: 

It is determined whether or not the value of the 
variable J is equal to or larger than the variable k, that 
15 is, whether or not a corresponding thread should execute a 
new parallel processing block. If the corresponding thread 
should execute a new parallel processing block, the program 
proceeds to a step S14, whereas if not, the program 
proceeds to a step S17. 
20 Step S14: 

The parallel processing block number 76a of the 
parallel processing control information region 76 is 
incremented by "1". 

Step S15: 

25 A parallel processing block control information 

region corresponding to the new parallel processing block 
is generated, and an executed thread number therefor is 
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initialized to "0", 
Step S16: 

Execution of a new thread is started. 
Step S17: 

5 A parallel processing block to be executed is 

determined with reference to the parallel processing block 
number of the thread information region. 
Step S18: 

The parallel processing block specified at the step 
10 817 is executed. 
Yi Step SI 9: 

: s S 
•■its- 

;^ The executed thread number of the corresponding 

j;LJ parallel processing block control information region is 

incremented by "1". 
;;P 15 Step S20: 

If the executed thread number becomes equal to the 
1=^ number ("5" in the FIG. 6 example) of the threads as a 

result of the increment at the step S19, the program 
proceeds to a step S21, whereas if not, the processing 
20 operation is terminated. 
Step S21: 

The parallel processing block control information 
region corresponding to the processed parallel processing 
block is deleted. 
25 According to the above processing operation, it is 

possible to realize the functions of the system described 
hereinabove . 
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Finally, the above processing functions can be 
implemented by a computer. In such a case, the details of 
processing functions that the information processing system 
should have are described in a program stored in a 
5 computer -readable storage medium. By executing the program 
by a computer, it is possible to perform the above - 
described processes. The computer-readable recording medium 
includes a magnetic recording device, semiconductor memory 
and the like. To distribute the program to the market, the 

10 program may be stored in portable storage media such as CD- 
ROMs (Compact Disk Read Only Memories) or floppy disks. 
Alternatively, the program may be stored in a storage 
device of a computer connected to a network and may be 
transferred to other computers through the network. To 

15 execute the program by a computer, the program stored in a 
hard disk unit or the like of the computer is loaded into 
the main memory and executed. 

As described hereinabove, according to the invention, 
an information processing method for causing a computing 

20 device having a plurality of processors to carry out 
predetermined information processing comprises a parallel 
processing block-forming step for dividing a program to be 
executed into a plurality of parallel processing blocks, a 
thread-forming step for dividing the parallel processing 

25 blocks generated by the parallel processing block-forming 
step into threads which are basic units to be assigned 
respectively to the plurality of processors for being 
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processed thereby, and an instructing step for instructing 
a predetermined processor to execute a next parallel 
processing block when the predetermined processor has 
terminated execution of the thread assigned thereto. 
Therefore, when the parallel processing blocks are 
successively processed, delay of processing conventionally 
caused by barriers can be eliminated, which makes it 
possible to increase the processing speed. 

The foregoing is considered as illustrative only of 
the principles of the present invention. Further, since 
numerous modifications and changes will readily occur to 
those skilled in the art, it is not desired to limit the 
invention to the exact construction and applications shown 
and described, and accordingly, all suitable modifications 
and equivalents may be regarded as falling within the scope 
of the invention in the appended claims and their 
equivalents . 



